Virtual creature control system and virtual creature control method

ABSTRACT

A virtual creature control system, including: a communication unit configured to receive information of current states of a plurality of virtual creatures and transmit a signal for controlling operations of the plurality of virtual creatures, at least one virtual creature among the plurality of virtual creatures being hardware; and a control unit configured to generate a signal for controlling an operation of the at least one virtual creature among the plurality of virtual creatures such that the plurality of virtual creatures are not visually recognized at a same time by a specific user and control the communication unit such that the signal is transmitted to the one virtual creature. The virtual creature control system and virtual creature control method can control the plurality of virtual creatures in conjunction and promote indirect communication among a plurality of spots using the virtual creatures.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. Ser. No. 16/305,100 filedNov. 28, 2018, which is a National Stage of PCT/JP2017/009337, filedMar. 8, 2017 and claims the benefit of Japanese Priority PatentApplication JP 2016-112922 filed on Jun. 6, 2016. The entire contents ofU.S. Ser. No. 16/305,100 are incorporated herein by reference.

TECHNICAL FIELD

The present disclosure relates to a virtual creature control system anda virtual creature control method.

BACKGROUND ART

For family members living at remote sites, it is important to have meansof communication, and direct communication means between remote sitessuch as telephones, video phones, mail, message applications, and thelike are already used.

Further, in recent years, service providing systems using robots orcommunication with robots have been proposed. For example, a networkrobot system in which a robot, a robot router (mobile terminal) thatcontrols the robot, and a space manager that manages a robot in a spaceand detects environments inside and outside the space are provided ineach of a plurality of spaces, and it is possible to perform a dynamicresponse as attribute information of a user is associated withenvironment information is disclosed in Patent Literature 1. In such asystem, the robot router can manipulate the robot in another spaceoutside the space on the basis of a control scenario, and, for example,a user carrying the robot router can also control a robot at home or thelike while at work.

Further, a system in which an autonomous robot associates various kindsof knowledge information used for control with knowledge IDs and managesservers is disclosed in Patent Literature 2. Accordingly, in a case inwhich an operation state of the first robot is a predetermined state(for example, a failure state), knowledge information of the first robotis allocated to a second robot, and thus it is possible to easilyperform robot exchange.

Further, a transceiving device that performs transmission and receptionof e-mails with animation display as if a pet were coming and going todeliver letters on a GUI screen imitating the insides of bothtransmitting and receiving rooms, and virtually raises an electronic petdisplayed in the form of animation is disclosed in Patent Literature 3.

CITATION LIST Patent Literature

-   Patent Literature 1: JP 2005-111637A-   Patent Literature 2: JP 2005-111603A-   Patent Literature 3: JP H11-65964A

DISCLOSURE OF INVENTION Technical Problem

However, the robots in a plurality of spots are recognized as individualrobots which are independently located at the respective spots, andrecognition in which users in a plurality of spots are in contact withthe same virtual creature is unable to be implemented.

In this regard, it is desirable to propose a virtual creature controlsystem and a virtual creature control method which are capable ofcontrolling a plurality of virtual creatures in conjunction andpromoting indirect communication among a plurality of spots using thevirtual creatures.

Solution to Problem

According to the present disclosure, there is proposed a virtualcreature control system, including: a communication unit configured toreceive information of current states of a plurality of virtualcreatures and transmit a signal for controlling operations the pluralityof virtual creatures, at least one virtual creature among the pluralityof virtual creatures being hardware; and a control unit configured togenerate a signal for controlling an operation of the at least onevirtual creature among the plurality of virtual creatures such that theplurality of virtual creatures are not visually recognized at a sametime by a specific user and control the communication unit such that thesignal is transmitted to the one virtual creature.

According to the present disclosure, there is proposed a virtualcreature control system, including: a plurality of virtual creatures, atleast one virtual creature among the plurality of virtual creaturesbeing hardware; a communication unit configured to receive informationof current states of the plurality of virtual creatures and transmit asignal for controlling operations of the plurality of virtual creatures;and a control unit configured to generate a signal for controlling anoperation of the at least one virtual creature among the plurality ofvirtual creatures such that the plurality of virtual creatures are notvisually recognized at a same time by a specific user and control thecommunication unit such that the signal is transmitted to the onevirtual creature.

According to the present disclosure, there is proposed a virtualcreature control method, including: causing, by a processor, acommunication unit to receive information of current states of aplurality of virtual creatures and transmit a signal for controllingoperations the plurality of virtual creatures, at least one virtualcreature among the plurality of virtual creatures being hardware; andgenerating, by the processor, a signal for controlling an operation ofthe at least one virtual creature among the plurality of virtualcreatures such that the plurality of virtual creatures are not visuallyrecognized at a same time by a specific user and controlling thecommunication unit such that the signal is transmitted to the onevirtual creature.

Advantageous Effects of Invention

As described above, according to the present disclosure, it is possibleto control a plurality of virtual creatures in conjunction and promoteindirect communication among a plurality of spots using the virtualcreatures.

Note that the effects described above are not necessarily limitative.With or in the place of the above effects, there may be achieved any oneof the effects described in this specification or other effects that maybe grasped from this specification.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating an overview of an informationprocessing system according to the present embodiment.

FIG. 2 is a diagram illustrating an overall configuration of aninformation processing system according to the present embodiment.

FIG. 3 is a diagram showing an example of virtualization of a pet robotaccording to the present embodiment.

FIG. 4 is a block diagram illustrating an example of a configuration ofa pet robot according to the present embodiment.

FIG. 5 is a block diagram illustrating an example of a configuration ofa cottage device according to the present embodiment.

FIG. 6 is a block diagram illustrating an example of a configuration ofa server according to the present embodiment.

FIG. 7 is a sequence diagram illustrating a cooperative operationcontrol process for a pet robot according to the present embodiment.

FIG. 8 is a sequence diagram illustrating an operation process ofreturning to a cottage according to the present embodiment.

FIG. 9 is a sequence diagram illustrating a user registration processaccording to the present embodiment.

FIG. 10 is a sequence diagram illustrating a cooperative operationcontrol process for a pet robot in a case in which family memberregistration is performed according to the present embodiment.

FIG. 11 is a sequence diagram illustrating operation control of actingcharming according to the present embodiment.

FIG. 12 is a sequence diagram illustrating a discipline control processaccording to the present embodiment.

FIG. 13 is a sequence diagram illustrating an operation process when anobject is handed over to a pet robot according to the presentembodiment.

FIG. 14 is a sequence diagram illustrating an operation process when anobject is handed over to a pet robot according to the presentembodiment.

FIG. 15 is a sequence diagram illustrating an operation process forimplementing an effect in which the weather is considered according tothe present embodiment.

FIG. 16 is a sequence diagram illustrating an operation control processin which a field of view of a family member is considered according tothe present embodiment.

FIG. 17 is a flowchart illustrating an operation control processaccording to a visually recognized situation according to the presentembodiment.

FIG. 18 is a sequence diagram illustrating an operation control processwhen communication occurs between a plurality of spots according to thepresent embodiment.

FIG. 19 is a sequence diagram illustrating an operation control processof giving a communication occurrence notification through a pet robotaccording to the present embodiment.

MODE(S) FOR CARRYING OUT THE INVENTION

Hereinafter, (a) preferred embodiment(s) of the present disclosure willbe described in detail with reference to the appended drawings. Notethat, in this specification and the appended drawings, structuralelements that have substantially the same function and structure aredenoted with the same reference numerals, and repeated explanation ofthese structural elements is omitted.

Further, the description will proceed in the following order.

-   -   1. Overview of information processing system according to one        embodiment of present disclosure    -   2. Configuration    -   2-1. Construction of pet robot    -   2-2. Configuration of cottage device    -   2-3. Configuration of server    -   3. Operation process    -   3-1. Cooperative operation control at remote site    -   3-2. Control of operation of returning to cottage    -   3-3. User registration    -   3-4. Operation control according to call from family member    -   3-5. Operation of acting charming    -   3-6. Discipline control    -   3-7. Operation of bringing object to remote site    -   3-8. Effect in which weather is considered    -   3-9. Operation control according to presence or absence of        nearby person    -   3-10. Operation control according to visually recognized        situation    -   3-11. Operation control according to communication between        plurality of spots    -   4. Conclusion        <<1. Overview of information processing system according to one        embodiment of present disclosure>>

First, an overview of an information processing system according to oneembodiment of the present disclosure will be described. FIG. 1 is adiagram for describing an overview of an information processing systemaccording to the present embodiment. As illustrated in FIG. 1 , in theinformation processing system (virtual creature control system)according to the present embodiment, pet robots 1 (1A and 1B) andcottage devices 3 (3A and 3B) that accommodate the pet robots 1 areprovided at a plurality of spots such as an A spot and a B spot. The petrobot 1 is a robot device having an entertainment property in which anappearance shape thereof is formed by imitating an animal such as a dogand is used as an example of a virtual creature in this specification.Further, the pet robot 1 can autonomously cause the eyes, the legs, orthe like to operate and express animal-like gestures. Further, thecottage device 3 is an example of an accommodating unit thataccommodates the pet robot 1.

(Background)

Here, with respect to communication between family members, for example,in a case in which a pet such as a dog or a cat is raised by a family,the pet becomes a topic between family members, or family members canshare the same experience through the pet, and thus the pet plays a roleof promoting communication indirectly. However, one pet is helpful forpromoting indirect communication only in a case in which the familymembers are living in the same place, and it is difficult to raise onepet between remote sites.

In this regard, in the information processing system according to thepresent embodiment, server management is performed so that a pluralityof pet robots arranged at remote sites are visually recognizedphysically as one pet robot at the same time, and thus it is possible tocause it look as if one pet is shared and raised between remote sitesregardless of remote sites.

For example, as illustrated in FIG. 1 , when the pet robot 1A is playingwith a user A at an A spot, if a user B at a B spot calls, the pet robot1A enters the cottage device 3A and disappears from a field of view ofthe user A, and then the pet robot 1B accommodated in the cottage device3B at the B spot comes out of the cottage device 3B. As described above,the pet robot 1A and the pet robot 1B are prevented from being visuallyrecognized by the user A and the user B at the same time, and thus it ispossible to cause the users to recognize one pet robot being raised bythe plurality of users, and the pet robot 1 becomes a topic between theuser A and the user B (for example, a grandmother and a grandchildliving apart from each other), so that communication is promoted.

Next, an overall configuration of the information processing systemaccording to the present embodiment which controls the pet robots 1A and1B will be described with reference to FIG. 2 . FIG. 2 is a diagram fordescribing an overall configuration of the information processing systemaccording to the present embodiment.

As illustrated in FIG. 2 , the information processing system accordingto the present embodiment includes the pet robots 1A and 1B, the cottagedevices 3A and 3B, and a server 4. The server 4 can establish aconnection with the pet robots 1A and 1B and the cottage devices 3A and3B via a network 5 and perform transmission and reception of data.

The server 4 recognizes states of the pet robots 1A and 1B,specifically, whether the pet robot 1 is inside or outside the cottagedevice 3 (accommodating unit) (whether or not the pet robot 1 isaccommodated in the cottage) and controls operations of the pet robots1A and 1B. Further, the server 4 accumulates knowledge informationacquired by the plurality of pet robots 1 at the respective spots(faces, predetermined actions, and the like of the family members,) sothat the plurality of pet robots 1 share the same knowledge information.The cottage device 3 serves as a place in which the pet robot 1 hidesitself and has a function of charging the pet robot 1. For example, whenthe pet robot 1 comes from the cottage device 3 and acts charming to thefamily member (shaking its tail, walking up to the family member, or thelike,), if the battery level is low, the pet robot 1 can enter thecottage device 3 and start charging.

Further, in the present embodiment, the pet robot 1 is used as anexample of a “virtual creature,” but the present embodiment is notlimited thereto, and a virtual entity displayed on a display terminal 7of a tablet terminal, a smartphone, or the like as illustrated in FIG. 3, that is, a tiny robot 71 of a software program, may be used. Amongrespective virtual creatures at a plurality of spots, at least onevirtual creature may be a robot, and the other virtual creatures may betiny robots of a software program. More specifically, for example, in acase in which one of the family members calls the pet robot from thedisplay terminal 7, the real robot (the pet robot 1) outside the cottagedevice 3 autonomously enters the cottage device 3 and starts charging,and the tiny robot 71 which is the virtual entity appears on a screentable of the display terminal 7. Thereafter, if another family membercalls the pet robot 1 toward the cottage device 3, control is performedsuch that the tiny robot 71 displayed on the display terminal 7disappears from the screen, and the pet robot 1 which is the real robotcomes out of the cottage device 3, and the tiny robot 71 and the petrobot 1 appear at the same time. The control of causing the tiny robot71 to disappear from the screen is assumed to be performed using, forexample, an animation in which the tiny robot 71 enters the cottagedisplayed on the screen, an animation in which the tiny robot 71 movesto the edge of the screen and frames out from the screen, and the like.As described above, even in a case in which there are a plurality ofrobots having different forms such as the real robot and the tiny robot,it is possible to cause a plurality of users to recognize them as onepet by performing control such that the plurality of robots are notvisually recognized by the plurality of users simultaneously.

The overview of the information processing system according to thepresent embodiment has been described above. Next, configurations of therespective devices included in the information processing systemaccording to the present embodiment will be specifically described withreference to the appended drawings.

<<2. Configuration>>

<2-1. Configuration of Pet Robot>

FIG. 4 is a block diagram illustrating an example of a configuration ofthe pet robot 1 according to the present embodiment. As illustrated inFIG. 4 , the pet robot 1 includes a control unit 10, a Wi-Fi (registeredtrademark) communication unit 11, an LTE communication unit 12, aBluetooth (registered trademark) communication unit 13, a positioninformation acquiring unit 14, a camera 15, an audio input unit 16, adrive unit 18, a touch sensor 19, a storage unit 20, a display unit 21,an audio output unit 22, an acceleration sensor 23, and an angularvelocity sensor 24.

(Control Unit 10)

The control unit 10 functions as an operation processing device and acontrol device, and controls an overall operation of the pet robot 1 inaccordance with various kinds of programs. The control unit 10 isrealized by an electronic circuit such as, for example, a centralprocessing unit (CPU), a microprocessor, or the like. Further, thecontrol unit 10 may include a read only memory (ROM) that stores aprogram, operation parameters, and the like to be used and a randomaccess memory (RAM) that temporarily stores parameters thatappropriately change and the like.

Further, the control unit 10 according to the present embodiment canperform autonomous control of operating automatically in accordance withvarious kinds of information obtained from the Wi-Fi communication unit11, the LTE communication unit 12, the Bluetooth communication unit 13,the position information acquiring unit 14, the camera 15, the audioinput unit 16, the touch sensor 19, the acceleration sensor 23, theangular velocity sensor 24, or the like.

The Wi-Fi communication unit 11 is a data transmission/reception unitusing a communication scheme according to an IEEE 802.11 standard. TheWi-Fi communication unit 11 can establish a wireless connection with thenetwork 5 and perform indoor positioning. Specifically, the Wi-Ficommunication unit 11 scans radio waves transmitted from a surroundingWi-Fi access point and acquires a beacon signal (including an SSID, aMAC address, and radio wave strength). Then, the Wi-Fi communicationunit 11 acquires a position of the Wi-Fi access point (from the network)on the basis of the beacon signal, calculates a distance from the Wi-Fiaccess point on the basis of the radio wave strength, and measures acurrent position of the pet robot 1.

The LTE communication unit 12 is a data transceiving unit using a LongTerm Evolution (LTE) scheme which is a new communication schemefollowing a third generation mobile communication scheme. The LTEcommunication unit 12 can establish a wireless connection with thenetwork 5 and perform transmission and reception of data with the server4.

The Bluetooth communication unit 13 is a data transceiving unit using acommunication scheme according to an IEEE 802.15.1 standard which isnear field communication. The Bluetooth communication unit 13 canspecify an inquiry procedure as a device discovery procedure anddiscover other devices through beacons transmitted from peripheraldevices. For example, the Bluetooth communication unit 13 receives abeacon broadcast from the cottage device 3 and estimates a positionalrelation with the cottage device 3 on the basis of a unique identifierincluded in the beacon or the radio wave strength.

The position information acquiring unit 14 has a function of detectingthe current position of the pet robot 1 on the basis of a signalacquired from the outside. Specifically, for example, the positioninformation acquiring unit 14 is realized by a Global Positioning System(GPS) unit, and receives radio waves from GPS satellites, detects aposition at which the pet robot 1 is located, and outputs the detectedposition information to the control unit 10. The position information istransmitted to the server 4 and accumulated as a position log of the petrobot 1. Further, the position information acquiring unit 14 may detectthe position through, for example, Wi-Fi, Bluetooth, transmission andreception with mobile phones, PHSs, smartphones, or the like, near fieldcommunication, or the like in addition to the GPS

The camera 15 includes a lens system including an imaging lens, adiaphragm, a zoom lens, a focus lens, and the like, a drive system thatperforms a focusing operation or a zooming operation on the lens system,and a solid state imaging element array that photoelectrically convertsimaging light obtained by the lens system and generates an imagingsignal, and the like. The solid-state imaging element array may berealized by, for example, a charge coupled device (CCD) sensor array ora complementary metal oxide semiconductor (CMOS) sensor array.

The audio input unit 16 collects a voice of the user or ambientenvironmental sounds and outputs an audio signal to the control unit 10.The audio input unit 16 is realized by a microphone, a microphoneamplifying unit that amplifies the audio signal obtained by themicrophone, and an A/D converter that converts the audio signal into adigital audio signal, and outputs the audio signal to the control unit10.

The drive unit 18 is a functional module for realizing a degree offreedom in each joint of the pet robot 1, and includes a plurality ofdriving units installed for each axis such as a roll, a pitch, a yaw,and the like in each joint. Each driving unit is constituted by acombination of a motor that performs a rotational motion on apredetermined axis, an encoder that detects a rotational position of themotor, and a driver that adaptively controls the rotational position orthe rotational speed of the motor on the basis of an output of theencoder.

The touch sensor 19 detects pressure received by physical pressure suchas “petting” or “patting” from the user. Further, the pet robot 1 mayhave a pressure sensor instead of or in addition to the touch sensor 19.

The storage unit 20 stores a program or the like used when the controlunit 10 executes various kinds of processes. Further, the storage unit20 is constituted by a storage device including a storage medium, arecording device that records data in the storage medium, a readingdevice that reads data from the storage medium, a deleting device thatdeletes data recorded in the storage medium, and the like.

The display unit 21 is a display device such as electronic paperinstalled to cover the surface of the pet robot 1. The display unit 21can display a coat state, clothes, or the like of the pet robot 1.

The audio output unit 22 is realized by a speaker and an amplifiercircuit for the speaker. Further, the audio output unit 22 outputs asound such as a barking sound.

The acceleration sensor 23 and the angular velocity sensor 24 detect adirection of the pet robot 1 or acceleration of a motion thereof.

The configuration of the pet robot 1 according to the present embodimenthas been specifically described above. Further, the configuration of thepet robot 1 according to the present embodiment is not limited thereto,and for example, the Wi-Fi communication unit 11, the LTE communicationunit 12, and the Bluetooth communication unit 13 may use othercommunication schemes.

Further, the pet robot 1 may use the camera 15 as a distance sensor formeasuring a distance to an object is located ahead or may separatelyinclude a sensor using an infrared system, an ultrasonic system, or thelike.

Further, for example, as illustrated in FIG. 2 , the pet robot 1 mayinclude a body unit 200, leg units 201 connected to front, back, left,and right parts of the body unit 200, a head unit 202 connected to afront end portion of the body unit 200, and a tail unit 203 connected toa rear end portion of the body unit 200. Further, the control unit 10formed by connecting a CPU, a dynamic random access memory (DRAM), aflash read only memory (ROM), a personal computer (PC) card interfacecircuit, and a signal processing circuit to one another via an internalbus and a battery serving as a power source of the pet robot 1 arestored in the body unit 200. Further, the Wi-Fi communication unit 11,the LTE communication unit 12, the Bluetooth communication unit 13, theposition information acquiring unit 14, the storage unit 20, theacceleration sensor 23, the angular velocity sensor 24, and the like arestored in the body unit 200.

Further, the camera 15 for imaging an external situation, the touchsensor 19 for detecting pressure received by a physical gesture such as“petting” or “patting” from the user, the audio input unit 16 forcollecting external sounds, the audio output unit 22 for outputting asound such as a barking sound, a distance sensor (not illustrated) formeasuring the distance to the object located ahead, and the like arearranged in the head unit 202 at predetermined positions. The camera 15may be installed at a position corresponding to an “eye” of the petrobot 1. Further, the camera 15 may be arranged at a forehead portion ofthe head unit 202, and a light emitting diode (LED) (not illustrated)may be arranged at the position corresponding to the “eye.”

Further, actuators and potentiometers which correspond in number to adegree of freedom are arranged in each joint portion of each leg unit201, each connected portion between each leg unit 201 and the body unit200, a connection portion of the head unit 202 and the body unit 200, aconnection portion of the tail of the tail unit 203, and the like. Forexample, the actuator includes a servo motor as a component. As theservomotor is driven, the leg unit 201 is controlled to transition to adesired attitude or motion.

A specific configuration example of the pet robot 1 described above isdisclosed in, for example, JP 2002-157596A. The entire content of JP2002-157596A is hereby incorporated by reference.

Further, the configuration of the pet robot 1 described above can alsobe applied to a case in which the pet robot 1 is the tiny robot 71.Specifically, the display terminal 7 that displays the tiny robot 71 hasa configuration corresponding to the control unit 10, the Wi-Ficommunication unit 11, the LTE communication unit 12, the Bluetoothcommunication unit 13, the position information acquiring unit 14, thecamera 15, the audio input unit 16, the touch sensor 19, the storageunit 20, the display unit 21, and the audio output unit 22. The tinyrobot 71 is displayed on the display unit 21 and can interact with theuser.

<2-2. Configuration of Cottage Device>

Next, a composition of the cottage device 3 according to the presentembodiment will be described. FIG. 5 is a block diagram illustrating anexample of a configuration of the cottage device 3 according to thepresent embodiment.

As illustrated in FIG. 5 , the cottage device 3 according to the presentembodiment includes a control unit 30, a Wi-Fi communication unit 31, aBluetooth communication unit 32, a camera 33, a storage unit 34, aprinter unit 35, a 3D printer unit 36, and a charging unit 37.

The control unit 30 functions as an operation processing device and acontrol device, and controls an overall operation of the cottage device3 in accordance with various kinds of programs. The control unit 30 isrealized by an electronic circuit such as, for example, a centralprocessing unit (CPU), a microprocessor, or the like. Further, thecontrol unit 30 may include a read only memory (ROM) that stores aprogram, operation parameters, and the like to be used and a randomaccess memory (RAM) that temporarily stores parameters thatappropriately change and the like.

Further, the control unit 30 according to the present embodiment alsoperforms control such that the captured image obtained from the camera33 is transmitted from the Wi-Fi communication unit 31 to the server 4.Further, the control unit 30 performs control such that the capturedimage received from the server 4 is printed from the printer unit 35 orthe 3D printer unit 36.

The Wi-Fi communication unit 31 is a data transceiving unit using thecommunication scheme in accordance with the IEEE 802.11 standard. TheWi-Fi communication unit 31 establishes a wireless connection with thenetwork 5, and performs transmission and reception of data with theserver 4. Further, the Wi-Fi communication unit 31 can acquire theposition of the cottage device 3 by indoor positioning.

The Bluetooth communication unit 32 is a data transceiving unit using acommunication scheme according to an IEEE 802.15.1 standard which isnear field communication. The Bluetooth communication unit 32 canbroadcast the beacon to nearby devices and inform the nearby devices ofthe position of the cottage device 3. Further, the Bluetoothcommunication unit 32 can communicate with the pet robot 1 and acquireinformation of the position or the situation of the pet robot 1.

The camera 33 includes a lens system including an imaging lens, adiaphragm, a zoom lens, a focus lens, and the like, a drive system thatperforms a focusing operation or a zooming operation on the lens system,and a solid state imaging element array that photoelectrically convertsimaging light obtained by the lens system and generates an imagingsignal, and the like. The solid-state imaging element array may berealized by, for example, a charge coupled device (CCD) sensor array ora complementary metal oxide semiconductor (CMOS) sensor array. Thecamera 33 is installed inside the cottage device 3 and images an objectput in the mouth of the pet robot 1.

The storage unit 34 stores a program or the like used when the controlunit 30 executes various kinds of processes. Further, the storage unit34 is constituted by a storage device including a storage medium, arecording device that records data in the storage medium, a readingdevice that reads data from the storage medium, a deleting device thatdeletes data recorded in the storage medium, and the like. Further, thestorage unit 34 according to the present embodiment stores theinformation of the position or the situation of the pet robot 1.

The printer unit 35 includes a mechanism for printing on the basis ofimage data.

The 3D printer unit 36 includes a mechanism for generating an object onthe basis of three-dimensional data.

The charging unit 37 includes a mechanism for charging the pet robot 1.

The configuration of the cottage device 3 according to the presentembodiment has been specifically described above. The camera 33, theprinter unit 35, the 3D printer unit 36, and the charging unit 37 arearranged inside the cottage device 3.

<2-3. Configuration of Server>

Next, a configuration of server 4 according to the present embodimentwill be described with reference to FIG. 6 . FIG. 6 is a block diagramillustrating an example of a configuration of the server 4 according tothe present embodiment.

As illustrated in FIG. 6 , the server 4 according to the presentembodiment has a control unit 40, a communication unit 41, and a storageunit 42.

The control unit 40 functions as an operation processing device and acontrol device, and controls an overall operation of the server 4 inaccordance with various kinds of programs. The control unit 10 isrealized by an electronic circuit such as, for example, a centralprocessing unit (CPU), a microprocessor, or the like. Further, thecontrol unit 10 may include a read only memory (ROM) that stores aprogram, operation parameters, and the like to be used and a randomaccess memory (RAM) that temporarily stores parameters thatappropriately change and the like.

Further, the control unit 40 according to the present embodimentfunctions as a situation recognizing unit 401, a pet control unit 402, aface recognizing unit 403, a voice recognizing unit 404, a voicesynthesizing unit 406, an operation learning unit 407, an objectrecognizing unit 408, and a weather information acquiring unit 409.

The situation recognizing unit 401 recognizes a situation of each petrobot 1 on the basis of information transmitted from each pet robot 1and each cottage device 3.

The pet control unit 402 controls the operation of each pet robot 1 bysending a control signal to each pet robot 1. Specifically, the petcontrol unit 402 generates a signal for controlling the operation of atleast one pet robot 1 among a plurality of pet robots 1 such that aplurality of pet robots 1 are not visually recognized at the same timeby a specific user and transmits the generated signal to the one petrobot 1.

The face recognizing unit 403 analyzes the captured image captured bythe pet robot 1 and recognizes a face image. Further, the facerecognizing unit 403 can also compare it with a user face image storedin the storage unit 42 and identify a person shown in the capturedimage.

The voice recognizing unit 404 analyzes an audio signal collected by thepet robot 1, converts speech of the user into text, and performsmorphological analysis, semantic analysis, and the like on the speechtext.

The voice synthesizing unit 406 generates an audio signal to be outputfrom the pet robot 1.

The operation learning unit 407 learns the operation of the pet robot 1and stores a learning result in the storage unit 42. For example, whenthe pet robot 1 is caused to randomly perform a predetermined operationin response to the speech of the user, if positive feedback is obtainedfrom the user, the operation learning unit 407 interprets that theoperation is correct and registers speech content and the operation inthe storage unit 42 in association with each other.

The object recognizing unit 408 analyzes the captured image andrecognizes the object shown in the captured image. For example, theobject recognizing unit 408 can analyze the captured image captured bythe cottage device 3 and recognize an object put in the mouth of the petrobot 1.

The weather information acquiring unit 409 acquires weather informationfrom another server (not illustrated) on the network. For example, theacquired weather information is used to display the coat of the petrobot 1 as if it were wet in the display unit 21 installed on thesurface of the pet robot 1 in a case in which the weather between the Aspot and the B spot is rainy.

The communication unit 41 is a communication module for performingtransmission and reception of data with other devices in awired/wireless manner. For example, the communication unit 41 performstransmission and reception of data with the pet robot 1 and the cottagedevice 3 at each spot via the network 5. More specifically, thecommunication unit 41 receives the current state of the pet robot 1(position information, whether the pet robot 1 is inside or outside thecottage, whether or not the pet robot 1 is operating in a free mode, orthe like) and transmits a signal (also referred to as a command in thisspecification) for controlling the pet robot 1.

The storage unit 42 stores a program or the like used when the controlunit 40 executes various kinds of processes. Further, the storage unit42 is constituted by a storage device including a storage medium, arecording device that records data in the storage medium, a readingdevice that reads data from the storage medium, a deleting device thatdeletes data recorded in the storage medium, and the like.

<<3. Operation process>>

Next, an operation process of the information processing systemaccording to the present embodiment will be described with reference toFIGS. 7 to 19 .

<3-1. Cooperative Operation Control at Remote Site>

First, cooperative operation control in the free mode will be describedas basic control with reference to FIG. 7 . In the case in which nospecial occasion occurs for each pet robot 1, the server 4 performs freemode control in which the pet robot 1 moves between the remote sites atappropriate timings and walks outside the cottage.

FIG. 7 is a sequence diagram illustrating the cooperative operationcontrol process for the pet robot according to the present embodiment.As illustrated in FIG. 7 , first, the server 4 recognizes the situationof the pet robot 1 at each spot using the situation recognizing unit 401(step S103). Specifically, for example, the situation recognizing unit401 acquires the position information and the driving states of the petrobots 1A and 1B, and the position information of the cottage devices 3Aand 3B, and recognizes whether the pet robot 1 is inside or outside thecottage device 3 from the positional relation between the pet robot 1and the cottage device 3. Alternatively, the situation recognizing unit401 recognizes whether the pet robot 1 is inside or outside the cottagedevice 3 on the basis of a detection result of a sensor (or the camera33) which is installed in the cottage device 3 and capable of detectingwhether or not the pet robot 1 is accommodated in the cottage. Here, forexample, a situation in which the pet robot 1A at the A spot is outsidethe cottage, and the pet robot 1B at the B spot is accommodated in thecottage (sleep state) is recognized.

Then, the server 4 sets a moving flag at a random or programmed timingthrough the pet control unit 402 (step S106).

Then, when the moving flag is set (YES in step S109), the pet controlunit 402 controls the pet robot 1A such that the pet robot 1A returns tothe cottage (step S112). Specifically, the pet control unit 402transmits a command for instructing the operation of returning to thecottage from the communication unit 41 to the pet robot 1A.

Then, the pet robot 1A performs an operation of autonomously returningto the cottage in accordance with the command from the server 4 (stepS115). The operation of returning to the cottage will be described laterin detail with reference to FIG. 8 .

Then, the pet robot 1A gives a notification indicating that theoperation of returning to the cottage is completed (that is, it entersthe sleep state) to the server 4 (step S118).

Then, if the server 4 receives the completion notice for the operationof returning to the cottage (the notification indicating that it entersthe sleep state) from the pet robot 1A, the server 4 transmits a commandfor instructing an operation of coming out of the cottage to the petrobot 1B (step S121).

Then, the pet robot 1B autonomously comes out of the cottage device 3Bin accordance with the command from the server 4 and performs, forexample, an operation of walking around or walking to a person whoseface is recognized.

As described above, in a case in which a plurality of pet robots 1 arelocated at remote sites, control is performed such that the pet robot 1does not simultaneously appear from the cottage device 3 at a pluralityof spots, and thus it is possible to implement an effect as if one petrobot moves between a plurality of spots. Further, such operationcontrol is not limited to control for the real robot, but is similarlyperformed for the tiny robot 71 displayed on the display terminal 7 ofthe tablet terminal or the like.

<3-2. Control of Operation of Returning to Cottage>

Next, the control of the operation of returning to the cottage describedin step S115 will be described with reference to FIG. 8 . FIG. 8 is asequence diagram illustrating the operation process of returning to thecottage according to the present embodiment.

As illustrated in FIG. 8 , first, the pet robot 1 and the cottage device3 transmit their own position information to the server 4 (step S133 andstep S136). A transmission timing of the position information is notparticularly limited, but the position information may be transmitted,for example, in a case in which there is a request from the server 4, ina case in which an instruction for the operation of returning to thecottage is given, or periodically. For example, the pet robot 1 acquiresthe current position through the position information acquiring unit 14or the Wi-Fi communication unit 11, and transmits the current positionto the server 4. Further, for example, the cottage device 3 acquires thecurrent position through the Wi-Fi communication unit 31, and transmitsthe current position to the server 4.

Then, the server 4 controls the pet robot 1 such that the pet robot 1approaches the cottage device 3 (step S139). Specifically, for example,the server 4 transmits a command for instructing approaching thecorresponding position to the pet robot 1 together with the positioninformation of the cottage device 3.

Then, the pet robot 1 moves toward the position of the cottage device 3in accordance with the command from the server 4 (step S142).Specifically, the pet robot 1 controls the drive unit 18, andautonomously moves toward the position of the cottage device 3.

If the pet robot 1 arrives near the position of the cottage (YES in stepS145), the pet robot 1 receives the beacon broadcast from Bluetoothcommunication unit 32 of the cottage device 3.

Then, upon receiving the beacon transmitted from the cottage device 3,the pet robot 1 images a surrounding area with the camera 15 (step S151)and transmits the captured image to the server 4 (step S154).

Then, the object recognizing unit 408 of the server 4 recognizes thecottage device 3 from the captured image (step S157). Accordingly, theserver 4 can more accurately detect a direction and a distance in whichthe cottage device 3 is located relative to the pet robot 1.

Then, the pet control unit 402 of the server 4 performs control suchthat the pet robot 1 is guided to move in the direction of the cottagedevice 3 recognized from the captured image (step S160). Specifically,for example, the pet control unit 402 transmits a command forinstructing the pet robot 1 to move to the cottage device 3 on the basisof the direction and the distance of the cottage device 3 from thecommunication unit 41 to the pet robot 1.

Then, the pet robot 1 moves closer to the cottage device 3 and entersthe cottage device 3 in accordance with the command from the server 4.

The control process when the pet robot 1 autonomously returns to thecottage device 3 has been described above. Further, in the aboveexample, control of guiding to the cottage device 3 is performed on thebasis of a combination the position information, the Bluetooth beacon,and the captured images of the cottage device 3 and the pet robot 1, butthe present embodiment is not limited thereto, and any other system maybe employed to detect the positions of the pet robot 1 and the cottagedevice 3 and cause the pet robot 1 to autonomously walk into the cottagedevice 3.

<3-3. User Registration>

Next, user registration for the pet robot 1 will be described withreference to FIG. 9 . FIG. 9 is a sequence diagram illustrating a userregistration process according to the present embodiment.

As illustrated in FIG. 9 , first, the server 4 performs activationcontrol for the pet robot 1A (step S203), and the pet robot 1A isactivated (step S206).

Then, the pet robot 1A images the surrounding area with the camera 15(step S209), and transmits the captured image to the server 4 (stepS212).

Then, the server 4 performs the face recognition on the captured imageby the face recognizing unit 403 (step S215).

Then, if the face is recognized from the captured image (step S218), thecontrol unit 40 of the server 4 registers the person as the familymember (step S221). Specifically, the control unit 40 stores therecognized face image or the feature quantity of the face in the storageunit 42. As described above, for example, it is possible to recognizeand register the person who is first recognized immediately afterpurchase as the family member.

Then, in a case in which the captured image is further transmitted fromthe pet robot 1A (step S224), the server 4 performs the face recognitionthrough the face recognizing unit 403 (step S227).

Then, in a case in which the face of another person is recognized fromthe captured image together with the registered family member on thebasis of the face recognition result (YES in step S230), the controlunit 40 of the server 4 recognizes the recognized new person as thefamily member (step S233). As described above, it is possible torecognize and register a person who is with the family member as thefamily member.

The server 4 performs a process similar to the family memberregistration processing described in steps S203 to S233 described abovefor the pet robot 1B (step S236). Accordingly, it is possible toregister the family member at the spot B. Even at the spot B, a personwho is first recognized after activated is registered as the familymember, and then a person who is with the family member is registered asthe family member.

Further, the “family member” is a target whom the pet robot 1 has to actcharming to or listen to an instruction from, and a friend who is withthe family member may be recognized and registered as the family member.

Further, the server 4 can also register a voice feature quantity of thefamily member. For example, the server 4 receives the captured imagecaptured by the pet robot 1 and the collected voice information when thefamily member speaks to the pet robot 1, analyzes the captured image andthe voice information, and stores the captured image and the soundinformation in the storage unit 42 as the voice feature quantity inassociation with the family member together with the face image.

<3-4. Operation Control According to Call from Family Member>

Next, an example of the free mode control in a case in which the familymember registration is performed will be described with reference toFIG. 10 . FIG. 10 is a sequence diagram illustrating the cooperativeoperation control process for the pet robot 1 in a case in which thefamily member registration is performed according to the presentembodiment.

As illustrated in FIG. 10 , the server 4 first recognizes the situationof the pet robot 1 at each spot through the situation recognizing unit401 (step S303). Here, for example, a situation in which the pet robot1A at the A spot is outside the cottage, and the pet robot 1B at the Bspot is accommodated in the cottage (sleep state) is recognized.

Then, the pet robot 1B continuously acquires ambient voices whilestaying in the cottage device 3B (step S306), and transmits the voiceinformation to the server 4 (step S309).

Then, the server 4 recognizes the voice received from the pet robot 1through the voice recognizing unit 404 (step S312).

Then, on the basis of the recognition result, the control unit 40 of theserver 4 determines whether or not there is a call from the familymember (step S315). Specifically, the control unit 40 recognizes whetheror not the voice is a voice of the family member on the basis of thevoice feature quantity of the family member (the voice quality or thelike) registered in the storage unit 42, and further recognizes the callfrom the family member (calling of the name of the pet robot 1B orcalling such as “come here!” or “come out!”).

In a case in which it is determined that there is a call from the familymember (YES in step S315), the pet control unit 402 of the server 4performs control such that the pet robot 1A returns to the cottage (stepS318).

Then, the pet robot 1 performs an operation of returning to the cottage(step S321), and gives a notification indicating that the operation ofreturning to the cottage is completed to the server 4 (step S324).

Then, if the completion notice for the operation of returning from thepet robot 1A to the cottage (the notification indicating that it entersthe sleep state) is received, the server 4 transmits a command forinstructing the pet robot 1B to come out of the cottage A and actcharming (activation instruction) to the pet robot 1B (step S327).

Then, in accordance with the command from the server 4, the pet robot 1Bcomes out of the cottage device 3B (step S330) and performs an operationof acting charming to the family member (step S333). The operation ofacting charming will be described below in detail with reference to FIG.11 .

As described above, in a case in which the family member at the remotesite calls, the pet robot 1A outside the cottage enters the cottage, andcontrol is performed such that the pet robot 1B at the spot in which thefamily member calls comes out of the cottage, and thus the effect as ifone pet robot moves between a plurality of spots can be implemented.

<3-5. Operation of Acting Charming>

FIG. 11 is a sequence diagram illustrating operation control of actingcharming according to the present embodiment.

As illustrated in FIG. 11 , the pet robot 1 first images the surroundarea with the camera 15 in a state in which it is outside the cottage(step S343) and transmits the captured image to the server 4 (stepS346). The pet robot 1 continuously images the surrounding area whilemoving around, and transmits the captured image to the server 4.

Then, the server 4 performs the face recognition on the basis of thecaptured image transmitted from the pet robot 1 through the facerecognizing unit 403 (step S349).

Then, the control unit 40 of the server 4 determines whether or not thefamily member is found on the basis of the face recognition result (stepS352).

Then, in a case in which the family member is found (YES in step S352),the pet control unit 402 performs control such that the pet robot 1approaches the family member (step S355). Specifically, the pet controlunit 402 estimates a direction in which the family member is present onthe basis of the recognition result of the captured image, and transmitsa command for instructing to the pet robot 1 to move in the estimateddirection.

Then, the pet robot 1 approaches the family member sufficiently inaccordance with the command from the server 4 (step S358). Further, thepet robot 1 continually images the surrounding area with the camera 15and transmits the captured image to the server 4. The server 4recognizes the face of the family member from the captured image,continuously estimates the direction in which the family member ispresent, and transmits a movement command to the pet robot 1.Accordingly, the pet robot 1 can sufficiently approach the familymember.

Then, in a case in which the pet robot 1 sufficiently approaches thefamily member (YES in step S358), the pet robot 1 looks at the face ofthe family member and performs, for example, an operation of shaking thetail (step S361). Here, the operation of shaking the tail has beendescribed as an example, but the operation of acting charming is notlimited thereto, and for example, an operation of squatting at the feetof the family member, an operation of sitting on the lap in a case inwhich the family member is sitting, or an operation of purring may beperformed.

<3-6. Discipline Control>

Next, discipline control for memorizing actions such as “hand,” “sit,”“lie” and the like will be described with reference to FIG. 12 . FIG. 12is a sequence diagram illustrating a discipline control processaccording to the present embodiment.

As illustrated in FIG. 12 , the pet robot 1 first images the surroundingarea with the camera 15, collects an ambient voice with the audio inputunit 16 (step S403), transmits the captured image and the collectedvoice to the server 4 (step S406).

Then, the server 4 performs the face recognition on the basis of thecaptured image transmitted from the pet robot 1 by the face recognizingunit 403 (step S409), and finds the face of the family member stored inthe storage unit 42 (step S412).

Then, in a case in which the family member is found on the basis of facerecognition result (YES in step S412), the server 4 performs voicerecognition on the basis of the collected voice transmitted from the petrobot 1 through the voice recognizing unit 404, and recognizes the voiceof the family member (step S415). For example, the server 4 recognizesthe user commands (“hand,” “sit,” “lie,” or the like) for the pet robot1.

Then, the pet control unit 402 of the server 4 randomly determines apose from a plurality of poses stored in the storage unit 42 (stepS418), and transmits a command for instructing to the pet robot 1 totake the decided pose (step S421). For example, the poses stored in thestorage unit 42 include various poses and actions (for example, “hand,”“sit,” “lie,” and the like) which are memorized by training.

Then, the pet robot 1 operates to take a pose in accordance with thecommand from the server 4 (step S424).

Then, it is determined whether or not feedback is obtained from thefamily member (step S427). For example, in a case in which the posetaken by the pet robot 1 in accordance with the command is in line withan intention of the family member who gave the command, the familymember is expected to pat the head or the torso of the pet robot 1 orsay a compliment such as “great!” or “good!.” The patting the head orthe torso can be detected by the touch sensor 19 of the pet robot 1.

Then, in a case in which certain feedback is obtained (YES in stepS427), the pet robot 1 transmits feedback information to the server 4(step S430).

Then, in a case in which the feedback obtained by the pet robot 1 is apositive one such as patting the head or the compliment described above,the operation learning unit 407 of the server 4 stores the pose decidedin step S418 in the storage unit 42 in association with the voicerecognized in step S409 (step S433).

As described above, it is possible to train the pet robot 1 to performpredetermined actions in response to calling. Further, since thememorized actions are managed by the server 4, for example, thediscipline performed on the pet robot 1A can also be reproduced by thepet robot 1B. More specifically, for example, the pet control unit 402transmits a control signal for instructing an action corresponding towhat the family member says to the pet robot 1B (the command forinstructing to take an associated pose) to the pet robot 1B on the basisof the learning result for the pose stored in the storage unit 42.Accordingly, it is possible to implement the effect of sharing andraising one pet robot between the remote sites.

Further, in the information processing system according to the presentembodiment, a gesture of the family member may be learned furthertogether with calling. For example, the operation learning unit 407 ofthe server 4 recognizes the gesture of the user from the captured imageand stores the gesture in association with it when learning the pose instep S433. Accordingly, it is possible to cause the pet robot 1 toperform a predetermined action when a certain gesture is taken.

<3-7. Operation of Bringing Object to Remote Site>

Then, control for implementing an effect in which the pet robot 1conveys an object between the remote site will be described withreference to FIGS. 13 and 14 . FIG. 13 and FIG. 14 are sequence diagramsillustrating an operation process in a case in which an object is passedto the pet robot 1 according to the present embodiment.

As illustrated in FIG. 13 , the server 4 first recognizes the situationof the pet robot 1 at each spot through the situation recognizing unit401 (step S503). Here, for example, a situation in which the pet robot1A at the A spot is outside the cottage, and the pet robot 1B at the Bspot is accommodated in the cottage is recognized.

Then, the pet robot 1A outside the cottage continuously images thesurrounding area with the camera 15 (step S506) and transmits thecaptured image to the server 4 (step S509).

Then, the server 4 performs the face recognition on the captured imagethrough the face recognizing unit 403 (step S512), and determineswhether or not the family member hands the object to the pet robot 1A(step S515).

Then, in a case in which it is determined that the family member handsthe object (Yes in step S515), the pet control unit 402 transmits acommand for instructing the pet robot 1A to put the object in the mouthand return to the cottage to the pet robot 1A (step S518).

Then, in accordance with the command from the server 4, the pet robot 1Amoves a part corresponding to the “mouth” to hold the object handed fromthe family member (step S521).

Then, the pet robot 1A performs an operation of returning to the cottagewhile putting the object in the mouth (step S524).

Then, the cottage device 3A captures the object brought by the pet robot1A through the camera 33 installed in the cottage (step S527) andtransmits the captured image to the server 4 (step S530).

Then, the server 4 analyzes the captured image through the objectrecognizing unit 408 and performs object recognition (step S533).

Then, as illustrated in FIG. 14 , the control unit 40 of the server 4determine whether or not the object brought by the pet robot 1A is apredetermined printable paper medium or a predetermined 3D printableobject on the basis of the object recognition result (step S536). Forexample, the predetermined printable paper medium or the predetermined3D printable object is a specific paper medium or object which isregistered in advance, and the control unit 40 recognizes a QR code(registered trademark) printed on the paper medium or the shape of theobject and determines whether or not it is printable.

Then, in a case in which it is determined to be not printable (NO instep S536), the pet control unit 402 of the server 4 gives a returninstruction to the pet robot 1A (step S560).

Then, the pet robot 1A performs an operation of coming out of thecottage while putting the object handed from the family member in the“mouth” in accordance with the return instruction (step S563).

On the other hand, in a case in which it is determined to be printable(YES in step S536), the control unit 40 of the server 4 transmits printdata to the cottage device 3B (step S539). Specifically, the controlunit 40 instructs the cottage device 3B to perform normal printing on apredetermined paper medium or perform 3D printing on a predeterminedobject.

Then, the cottage device 3B performs printing through the printer unit35 or the 3D printer unit 36 installed inside the cottage on the basisof the received print data (step S542), and if the printing ends, thecottage device 3B transmits a print completion notification to theserver 4 (step S545).

Then, if the print completion notification is received from the cottagedevice 3B, the pet control unit 402 of the server 4 gives a storageinstruction to the cottage device 3A (step S548).

Then, in accordance with the storage instruction from the server 4, thecottage device 3A stores the object brought by the pet robot 1A to beinvisible from the outside of the cottage (step S551). For example, thecottage device 3A covers a place in which the object in the cottage areplaced with a cover or a door.

Then, the server 4 transmits a command for instructing the pet robot 1Bto put in the printed object in the mouth and come out of the cottage tothe pet robot 1B (step S554).

Then, the pet robot 1B performs the operation of putting the printedobject in the mouth and coming out of the cottage in accordance with thecommand from the server 4 (step S557). Accordingly, it looks that thepet robot 1 conveys the object (for example, a letter or a ball) handedfrom the family member to the remote site. Further, there is noparticular limitation on a structure of the part corresponding to the“mouth” in which the pet robot 1 put the object and a specific structureof the inside of the cottage device 3.

<3-8. Effect in Which Weather is Considered>

Next, a process of further emphasizing an effect in which the pet robot1 looks to move between the remote sites will be described withreference to FIG. 15 . Specifically, an effect as if the pet robot movesbetween the remote sites actually is emphasized by reflecting theweather between the remote sites in the state of the pet robot 1.

FIG. 15 is a sequence diagram illustrating an operation process forimplementing an effect in which the weather is considered according tothe present embodiment. As illustrated in FIG. 15 , the server 4 firstrecognizes the situation of the pet robot 1 at each spot using thesituation recognizing unit 401 (step S603). Here, for example, asituation in which the pet robot 1A at the A spot is outside thecottage, and the pet robot 1B at the B spot is accommodated in thecottage is recognized.

Then, the server 4 sets a moving flag at a random or programmed timingthrough the pet control unit 402 (step S606).

Then, when the moving flag is set (YES in step S609), the pet controlunit 402 controls the pet robot 1A such that the pet robot 1A returns tothe cottage (step S612). Specifically, the pet control unit 402transmits a command for instructing the operation of returning to thecottage from the communication unit 41 to the pet robot 1A.

Then, the pet robot 1A performs the operation of returning to thecottage in accordance with the command from the server 4 (step S615).

Then, the pet robot 1A gives a notification indicating that theoperation of returning to the cottage is completed to the server 4 (stepS618).

Then, if the completion notice for the operation of returning to thecottage is received from the pet robot 1A, the server 4 acquires thepositions of the pet robots 1A and 1B (step S621), and further acquiresweather information between the positions of the pet robots 1A and 1Bfrom a predetermined server (not illustrated) on the network through theweather information acquiring unit 409 (step S624).

Then, in a case in which the weather is rainy (YES in step S627), thepet control unit 402 of the server 4 performs control such that the petrobot 1B comes out of the cottage with an effect in which it gets wetwith rain (step S630). Specifically, the pet control unit 402 transmitsan image signal (an image of the coat wet with rain or the like)displayed on the display unit 21 installed on the surface of the petrobot 1B. Further, in a case in which the weather is snowy, the petcontrol unit 402 may perform control such that an effect in which snowsare on the body is implemented.

Then, in accordance with the command from the server 4, the pet robot 1Breproduces the rain-wet state by displaying the rain-wet coat on thedisplay unit 21 installed on the surface of the body (step S633), andcomes out of the cottage (step S639). As described above, if it israining between the A spot and the B spot, it can emphasize movingbetween the remote sites by implementing an effect in which it gets wetwith rain.

On the other hand, in a case in which the weather is not rainy (NO instep S627), control is performed such that the pet robot comes out ofthe cottage without implementing the effect described above (step S636),and the pet robot 1B comes out of the cottage (step S639).

<3-9. Operation Control According to Presence/absence of Nearby Person>

In the example described above, control is performed such that the petrobots 1 at a plurality of spots do not appear at the same time, and onepet robot 1 appears, but the present embodiment is not limited thereto.For example, “control may be performed such that the pet robots 1 at aplurality of spots looks one pet robot” in consideration of a field ofview of the family member. This will be described below with referenceto FIG. 16 .

FIG. 16 is a sequence diagram illustrating an operation control processin which a field of view of a family member is considered. Asillustrated in FIG. 16 , the server 4 first recognizes the situation ofthe pet robot 1 at each spot using the situation recognizing unit 401(step S653). Here, for example, a situation in which the pet robot 1A atthe A spot is outside the cottage, and the pet robot 1B at the B spot isaccommodated in the cottage is recognized.

Then, the pet robot 1A outside the cottage continuously images thesurrounding area with the camera 15, collects the ambient voice with theaudio input unit 16 (step S656), and transmits the captured image andthe collected voice to the server 4 (step S659).

Then, the server 4 performs the face recognition on the captured imagethrough the face recognizing unit 403 and performs the voice recognitionthrough the voice recognizing unit 404 (step S662).

Then, the control unit 40 of the server 4 determines whether or notthere is a nearby person on the basis of the image recognition resultand the voice recognition result (step S665).

Then, in a case in which it is determined that there is no nearby person(step YES in S665), the pet control unit 402 of the server 4 performscontrol such that the pet robot 1A stop moving (step S668).

Then, the pet robot 1A stops the operation at the place in accordancewith the command from the server 4 (step S671). Specifically, the petrobot 1A stops power supply to the drive unit 18. In the case of thefree mode, the pet robot 1 performs the operation of moving aroundoutside the cottage, but in a case in which there is no nearby person,it is possible to prevent energy consumption by stopping the operation.

On the other hand, at the B spot, the pet robot 1B continuously acquiresthe ambient voice while staying in the cottage device 3B (step S674),and transmits the voice information to the server 4 (step S677).

Then, the server 4 recognizes the voice received from the pet robot 1through the voice recognizing unit 404 (step S680).

Then, on the basis of the recognition result, the control unit 40 of theserver 4 determines whether or not there is a call from the familymember (step S680). Specifically, the control unit 40 recognizes whetheror not the voice is a voice of the family member on the basis of thevoice feature quantity of the family member (the voice quality or thelike) registered in the storage unit 42, and further recognizes the callfrom the family member (calling of the name of the pet robot 1B orcalling such as “come here!” or “come out!”).

Then, in a case in which it is determined that the family member hasbeen called (YES in step S683), the pet control unit 402 of the server 4transmits a command instructing the pet robot 1B to exit from cottageand perform the operation of acting charming (step S686).

Then, in accordance with the command from the server 4, the pet robot 1Bcomes out of the cottage device 3B (step S689) and performs theoperation of acting charming to the family member (step S692). At thistime point, the pet robots 1 appears simultaneously from the cottagedevices 3 at both of the A spot and the B spot, but the pet robot 1A isnot visually recognized by the family member because there is a nearbyperson at the A spot. Therefore, a problem does not occur in “controlfor causing the pet robots to look one pet robot,” and it is possible toimplement energy saving by stopping driving of the pet robot 1A.

Further, on the A spot side, the pet robot 1A continually detects theambient sound (step S695).

Then, in a case in which the sound is detected (YES in step S695), thepet robot 1A resumes the operation, that is, resumes the power supply tothe drive unit 18 (step S698), and performs the operation of returningto the cottage device 3A (step S701). Accordingly, in a case in whichfamily member comes back, since the pet robot 1A is accommodated in thecottage device 3A, it is possible to solve the situation in which thepet robots 1 simultaneously appears at a plurality of spots.

<3-10. Operation Control According to Visually Recognized Situation>

In the operation control according to the presence or absence of thenearby person described above, since the pet robot 1 is not visible tothe family member if there is no nearby person, although the pet robots1 appear at the same time at a plurality of spots, a problem does notoccur. However, in a case in which a security camera, a surveillancecamera, or the like is installed, the user is likely to notice that thepet robots 1 appear at the same time later. In this regard, in thepresent embodiment, operation control is performed in consideration ofthe visually recognized situation such that a problem does not occur in“control causing pet robots to look one pet robot.” This will bedescribed below with reference to FIG. 17 .

FIG. 17 is a flowchart according to a visually recognized situation. Asillustrated in FIG. 17 , the server 4 first recognizes the situation ofthe pet robot 1 at each spot using the situation recognizing unit 401(step S713). Here, for example, a situation in which the pet robot 1A atthe A spot is outside the cottage, and the pet robot 1B at the B spot isaccommodated in the cottage is recognized.

Then, the pet robot 1B continuously acquires ambient voices whilestaying in the cottage device 3B (step S716), and transmits the voiceinformation to the server 4 (step S719).

Then, the server 4 recognizes the voice received from the pet robot 1through the voice recognizing unit 404 (step S722).

Then, the control unit 40 of the server 4 determines whether or notthere is an activation request (a call from the family member. Forexample, calling of the name of the pet robot 1B or calling such as“come here!” or “come out!”) from the family member (step S725).

In a case in which it is determined that there is an activation request(YES in step S725), the control unit 40 of the server 4 determineswhether or not the pet robot 1A is in the state which it is visuallyrecognized by the family member at the B spot (step S728). For example,in a case in which information of the security camera or thesurveillance camera installed at the A spot can be acquired by thesystem, since the control unit 40 determines that the pet robot 1A is inthe state which it is visually being recognized by the family member atthe B spot since the pet robot 1A is likely to be visually recognized bythe family member at the B spot. More specifically, for example, a livecamera is assumed to be installed as a service for watching an eldercouple living at the A spot. In this case, since a daughter familyliving at the B spot can see a video of the live camera, thesimultaneous appearance of the pet robots 1 is likely to be recognized.Further, since the live camera is assumed to be installed at both spots,the control unit 40 may determine whether or not the pet robot 1B at theB spot is in the state in which it is not visually recognized by thefamily member at the A spot together.

Then, in a case in which it is determined that the pet robot 1A is inthe state which it is not visually being recognized by the family memberat the B spot (that the security camera or the like is not installed)(YES in step S728), the pet control unit 402 of the server 4 transmits acommand for an activation instruction (specifically, for example, aninstruction to come out of the cottage and performing the operation ofacting charming) to the pet robot 1B (step S731).

Then, in accordance with the command from the server 4, the pet robot 1Bcomes out of the cottage device 3B (step S734) and performs theoperation of acting charming to the family member (step S737). At thistime point, the pet robots 1 simultaneously appear from the cottagedevices 3 at both the A spot and the B spot, but since the family memberat the B spot is unable to visually recognize the pet robot 1A appearingat the A spot, they can be recognized as one pet robot.

On the other hand, in a case in which it is determined that the petrobot 1A is in the state which it is visually being recognized by thefamily member at the B spot (that the security camera or the like isinstalled) (NO in step S728), the pet control unit 402 of the server 4performs control such that the pet robot 1A returns to the cottage(enters the sleep state) (step S740).

Then, the pet robot 1A performs the operation of returning to thecottage in accordance with the command from the server 4 (step S743),and gives the notification indicating that the operation of returning tothe cottage is completed to the server 4 (step S746).

Then, the pet control unit 402 of the server 4 receives the completionnotice for the operation of returning to the cottage from the pet robot1A, and then transmits the command of the activation instruction to thepet robot 1B (step S749). In accordance with the command from the server4, the pet robot 1B comes out of the cottage device 3B (step S734) andperforms the operation of acting charming to the family member (stepS737).

The operation control according to the visually recognized situation hasbeen described above. Further, in a case in which a setting to strictlyprohibit simultaneous appearance is performed in advance, regardless ofthe visually recognized situation, the server 4 performs the operationprocess illustrated in FIG. 7 described above, so that the simultaneousappearance of the pet robots 1 at a plurality of spots is prevented.

(Communication Between a Plurality of Spots)

As a case in which it is recognized that the respective pet robots 1simultaneously appear at a plurality of spots, in addition to the casein which the security camera, the surveillance camera, or the likedescribed above are installed, a case in which communication such as atelephone call is performed between the family members at a plurality ofspots is assumed. For example, when the family member at the A spot andthe B spot are talking on the phone (a voice call or a video call), ifthe pet robots 1 at both spots come out of the cottages, there is apossibility of the occurrence of contradiction in conversation. In thisregard, in the present embodiment, in a case in which the pet robotssimultaneously appear, and communication is performed between aplurality of spots, the contradiction can be resolved by performingcontrol such that one pet robot 1 returns to the cottage. This will bedescribed in detail with reference to FIG. 18 .

FIG. 18 is a sequence diagram illustrating an operation control processwhen communication occurs between a plurality of spots according to thepresent embodiment. As illustrated in FIG. 18 , the server 4 firstrecognizes the situation of the pet robot 1 at each spot through thesituation recognizing unit 401 (step S803). Here, for example, asituation in which the pet robot 1A at the A spot is outside thecottage, and the pet robot 1B at the B spot comes out of the cottage isrecognized.

Then, the server 4 detects that there is a telephone call from thefamily member at the A spot to the family member at the B spot (stepS806). The server 4 can detect that communication such as a telephonecall occurs between the remote sites in conjunction with, for example, asmartphone.

Then, the pet control unit 402 of the server 4 performs controls suchthat either of the pet robots 1A and 1B, here, for example, the petrobot 1A returns to the cottage (step S809). The pet robot selected fromamong a plurality of pet robots 1 is decided randomly or in accordancewith a program.

Then, the pet robot 1A performs the operation of returning to thecottage in accordance with the control from the server 4 (step S812),and gives the notification indicating that the operation of returning tothe cottage is completed to the server 4 (step S815).

Accordingly, in a case in which communication occurs between a pluralityof spots in the situation in which the pet robots 1 at a plurality ofspots simultaneously appears, it is possible to prevent the occurrenceof contradiction related to the presence of the pet robot during thecommunication by performing control such that only one pet robotremains, and the other pet robots excluding returns to the cottage.

<3-11. Operation Control According to Communication Between a Pluralityof Spots>

In the present embodiment, it is also possible to inform the remote siteof the occurrence of such communication through the pet robot 1 in acase in which communication such as a telephone call or the like occursbetween a plurality of spots. This will be described in detail withreference to FIG. 19 .

FIG. 19 is a sequence diagram illustrating an operation control processof giving a communication occurrence notification through the pet robot1 according to the present embodiment. As illustrated in FIG. 19 , theserver 4 first recognizes the situation of the pet robot 1 at each spotthrough the situation recognizing unit 401 (step S853). Here, forexample, a situation in which the pet robot 1A at the A spot is outsidethe cottage, and the pet robot 1B at the B spot is accommodated in thecottage is recognized.

Then, the server 4 detects, for example, that there is a telephone call(a voice call or a video call) from the family member at the A spot tothe family member at the B spot (step S856). The server 4 can detectthat communication such as a telephone call occurs between the remotesites in conjunction with, for example, a smartphone.

Then, the pet control unit 402 of the server 4 performs control suchthat the pet robot 1A at the spot in which the caller is located returnsto the cottage for (step S859).

Then, the pet robot 1A performs the operation of returning to thecottage in accordance with the control from the server 4 (step S862),and gives the notification indicating that the operation of returning tothe cottage is completed to the server 4 (step S865).

Then, if the completion notification for the operation of returning tothe cottage is received from the pet robot 1A, the server 4 transmits acommand for instructing the pet robot 1B to come out of the cottage andgive a notification indicating an incoming call to the pet robot 1B(step S868). In a case in which the notification indicating the incomingcall is given through a sound output, the server 4 generates a speakingvoice or a barking sound through the voice synthesizing unit 406, andtransmits the speaking voice or the barking sound to the pet robot 1Btogether with the command.

Then, the pet robot 1B comes out of the cottage device 3B in accordancewith the command from the server 4 (step S871), and give thenotification indicating the incoming call the family member throughbarking (step S874). Accordingly, it is possible to implement an effectas if one pet robot 1 moves from the A spot to the B spot and conveysthe call from the A spot.

<<4. Conclusion>>

As described above, in the information processing system according tothe embodiment of the present disclosure, it is possible to control aplurality of virtual creatures in conjunction and promote indirectcommunication among a plurality of spots using the virtual creatures.

The preferred embodiment(s) of the present disclosure has/have beendescribed above with reference to the accompanying drawings, whilst thepresent disclosure is not limited to the above examples. A personskilled in the art may find various alterations and modifications withinthe scope of the appended claims, and it should be understood that theywill naturally come under the technical scope of the present disclosure.

For example, it is possible to create a computer program causinghardware such as a CPU, a ROM, and a ROM installed in each of the petrobot 1, the cottage device 3, and the server 4 of the informationprocessing system described above to perform the functions of theinformation processing system. Further, a computer readable storagemedium having the computer program stored therein is also provided.

Further, in the above embodiments, the control for the respective petrobots 1A and 1B at the two spots such as the A spot and the B spot hasbeen mainly described, but the present embodiment is not limitedthereto, and control for respective (three) pet robots 1A and 1B at twoor more spots, for example, an A spot, a B spot, or a C spot can besimilarly controlled as well.

Further, the effects described in this specification are merelyillustrative or exemplified effects, and are not limitative. That is,with or in the place of the above effects, the technology according tothe present disclosure may achieve other effects that are clear to thoseskilled in the art from the description of this specification.

Additionally, the present technology may also be configured as below.

(1)

A virtual creature control system, including:

-   -   a communication unit configured to receive information of        current states of a plurality of virtual creatures and transmit        a signal for controlling operations the plurality of virtual        creatures, at least one virtual creature among the plurality of        virtual creatures being hardware; and    -   a control unit configured to generate a signal for controlling        an operation of the at least one virtual creature among the        plurality of virtual creatures such that the plurality of        virtual creatures are not visually recognized at a same time by        a specific user and control the communication unit such that the        signal is transmitted to the one virtual creature.        (2)

The virtual creature control system according to (1), in which, ifinformation of the current state indicating that a first virtualcreature enters a sleep state in which the first virtual creature is notvisually recognized by the specific user is received through thecommunication unit,

-   -   the control unit transmits a signal for permitting activation to        a second virtual creature in a sleep state through the        communication unit.        (3)

The virtual creature control system according to (2), in which the firstvirtual creature is a robot, and

-   -   the sleep state is a state in which the first virtual creature        autonomously moves into an accommodating unit such that the        first virtual creature is not visually recognized by the        specific user.        (4)

The virtual creature control system according to (2), in which the firstvirtual creature is a software program, and

-   -   the sleep state is a state in which the first virtual creature        displayed on a display unit of a device in which the software        program is installed disappears from the display unit such that        the first virtual creature is not visually recognized by the        specific user.        (5)

The virtual creature control system according to (2) or (3), in whichthe first virtual creature is in an activated state, and the secondvirtual creature is in the sleep state,

-   -   the first virtual creature is able to autonomously move into an        accommodating unit such that the first virtual creature is not        visually recognized by the first user while holding an object        handed to it by a first user,    -   the communication unit receives a captured image obtained by        imaging the object held by the first virtual creature,    -   the control unit recognizes the held object on a basis of the        captured image, transmits data for reproducing the object to the        accommodating unit in which the second virtual creature is        accommodated, and gives an instruction to reproduce the object        through a reproducing unit installed in the accommodating unit,        and    -   the control unit transmits a control signal for permitting        activation and further giving an instruction to come out of the        accommodating unit while holding the object reproduced by the        reproducing unit to the second virtual creature.        (6)

The virtual creature control system according to (2) or (3), in whichthe first virtual creature is in an activated state, and the secondvirtual creature is in the sleep state,

-   -   the control unit manages current positions of the first virtual        creature and the second virtual creature and is able to acquire        weather information between respective spots, and    -   if the information of the current state indicating that the        first virtual creature enters a sleep state in which the first        virtual creature is not visually recognized by the specific user        is received through the communication unit,    -   the control unit transmits a signal for permitting activation        and an image signal to be displayed on a display unit installed        on a surface of the second virtual creature according to the        weather information between the respective spots to the second        virtual creature in the sleep state through the communication        unit.        (7)

The virtual creature control system according to (2) or (3), in whichthe communication unit receives knowledge about a user learned by thefirst virtual creature, and

-   -   the control unit controls the communication unit such that a        signal for controlling an operation of a second virtual creature        generated on a basis of the knowledge is transmitted to the        second virtual creature through the communication unit.        (8)

The virtual creature control system according to (7), in which thecontrol unit transmits a control signal for giving an instruction totake a randomly selected pose in response to calling of a first user tothe first virtual creature,

-   -   the control unit receives feedback of the first user on the pose        as the knowledge about the user learned by the first virtual        creature through the communication unit, and    -   the control unit stores the randomly selected pose in        association with the calling in accordance with the feedback.        (9)

The virtual creature control system according to (7), in which thecontrol unit receives a face image of the first user captured by thefirst virtual creature as the knowledge about the user learned by thefirst virtual creature through the communication unit, and

-   -   the control unit stores a recognition result for the face image.        (10)

The virtual creature control system according to (9), in which, in acase in which a person shown together with the stored first user isrecognized from the captured image captured by the first virtualcreature, the control unit stores a recognition result for a face of theperson.

(11)

The virtual creature control system according to (2) or (3), in which,when the first virtual creature is in an activated state, and the secondvirtual creature is in the sleep state,

-   -   when information of a current state of the second virtual        creature received through the communication unit indicates an        activation request from the specific user, and information of a        current state of the first virtual creature indicates that the        current state of the first virtual creature is not a state seen        by the specific user,    -   the control unit transmits a signal for permitting activation to        the second virtual creature without transmitting a control        signal for giving an instruction to enter the sleep state to the        first virtual creature through the communication unit.        (12)

The virtual creature control system according to (11), in which, whenthere is a camera configured to monitor any one of the first and secondvirtual creatures, the control unit transmits a control signal forgiving an instruction to enter the sleep state to the first virtualcreature through the communication unit, and transmits a signal forpermitting activation to the second virtual creature.

(13)

The virtual creature control system according to (11), in which, when itis detected that a first user near the first virtual creature makes acommunication request to a second user near the second virtual creature,the control unit transmits a control signal for giving an instruction toenter the sleep state to the first virtual creature through thecommunication unit.

(14)

The virtual creature control system according to (2) or (3), in which,if it is detected that a first user near the first virtual creaturemakes a communication request to a second user near the second virtualcreature,

-   -   the control unit transmits a control signal for giving an        instruction to enter the sleep state to the first virtual        creature through the communication unit, and    -   further, if information of the current state indicating that the        first virtual creature is in the sleep state is received through        the communication unit,    -   the control unit transmits a signal of permitting activation and        a control signal for giving an instruction to give a        notification indicating that there is a communication request        from the first user to the second user to the second virtual        creature through the communication unit.        (15)

The virtual creature control system according to (2) or (3), in which,when the first virtual creature is in an activated state,

-   -   when information of the current state of the first virtual        creature received through the communication unit indicates that        there is no nearby user,    -   the control unit transmits a control signal for giving an        instruction to stop an operation to the first virtual creature        through the communication unit, and    -   when the information of the current state of the first virtual        creature indicates that a voice of a predetermined level or        higher is detected in a state in which the operation is stopped,    -   the control unit transmits a signal of permitting activation to        the first virtual creature through the communication unit.        (16)

The virtual creature control system according to (1), in which any onevirtual creature among the plurality of virtual creatures is in anactivated state, and other virtual creatures are in sleep state,

-   -   the control unit continuously sets a moving flag at a        predetermined timing,    -   the control unit transmits a control signal for giving an        instruction to enter the sleep state to the virtual creature in        the activated state when the moving flag is set, and    -   if the information of the current state indicating that the        virtual creature in the activated state enters the sleep state        in accordance with the control signal is received, the control        unit transmits a control signal for permitting activation to any        one virtual creature among the other virtual creatures in the        sleep state.        (17)

A virtual creature control system, including:

-   -   a plurality of virtual creatures, at least one virtual creature        among the plurality of virtual creatures being hardware;    -   a communication unit configured to receive information of        current states of the plurality of virtual creatures and        transmit a signal for controlling operations of the plurality of        virtual creatures; and    -   a control unit configured to generate a signal for controlling        an operation of the at least one virtual creature among the        plurality of virtual creatures such that the plurality of        virtual creatures are not visually recognized at a same time by        a specific user and control the communication unit such that the        signal is transmitted to the one virtual creature.        (18)

A virtual creature control method, including:

-   -   causing, by a processor, a communication unit to receive        information of current states of a plurality of virtual        creatures and transmit a signal for controlling operations the        plurality of virtual creatures, at least one virtual creature        among the plurality of virtual creatures being hardware; and    -   generating, by the processor, a signal for controlling an        operation of the at least one virtual creature among the        plurality of virtual creatures such that the plurality of        virtual creatures are not visually recognized at a same time by        a specific user and controlling the communication unit such that        the signal is transmitted to the one virtual creature.

REFERENCE SIGNS LIST

-   -   1, 1A, 1B pet robot    -   3, 3A, 3B cottage device    -   4 server    -   5 network    -   7 display terminal    -   10 control unit    -   11 Wi-Fi communication unit    -   12 LTE communication unit    -   13 Bluetooth communication unit    -   14 position information acquiring unit    -   15 camera    -   16 audio input unit    -   18 drive unit    -   19 touch sensor    -   20 storage unit    -   21 display unit    -   22 audio output unit    -   23 acceleration sensor    -   24 angular velocity sensor    -   30 control unit    -   31 Wi-Fi communication unit    -   32 Bluetooth communication unit    -   33 camera    -   34 storage unit    -   35 printer unit    -   36 3D printer unit    -   37 charging unit    -   40 control unit    -   41 communication unit    -   42 storage unit    -   401 situation recognizing unit    -   402 pet control unit    -   403 face recognizing unit    -   404 voice recognizing unit    -   406 voice synthesizing unit    -   407 operation learning unit    -   408 object recognizing unit    -   409 weather information acquiring unit

The invention claimed is:
 1. A virtual creature management server,comprising: processing circuitry configured to: receive informationindicating current states of a plurality of virtual creatures, theplurality of virtual creatures being visually recognized as a samecreature, and each virtual creature of the plurality of virtualcreatures being implemented either as a robotic device or as a virtualentity generated by executing a software program; generate, according tothe current states of the plurality of virtual creatures, at least onesignal for controlling an operation of at least one virtual creatureamong the plurality of virtual creatures, such that one of the pluralityof virtual creatures is visually recognizable at a time; and transmitthe at least one signal to the at least one virtual creature.
 2. Thevirtual creature management server according to claim 1, wherein theprocessing circuitry is further configured to: when the informationindicates that a first virtual creature enters a sleep statecorresponding to being not visually recognizable, transmit a firstcontrol signal to a second virtual creature that is in the sleep state,the first control signal setting the second virtual creature to anactivation state corresponding to being visually recognizable.
 3. Thevirtual creature management server according to claim 2, wherein thefirst virtual creature is implemented as a first robotic device, and thefirst virtual creature enters the sleep state when the first roboticdevice moves into an accommodating unit such that the first virtualcreature is not visually recognizable.
 4. The virtual creaturemanagement server according to claim 2, wherein the first virtualcreature is implemented as a first virtual entity generated by aterminal device executing the software program, and the first virtualcreature enters the sleep state when the first virtual entity is set tobe invisible on a display of the terminal device such that the firstvirtual creature is not visually recognizable.
 5. The virtual creaturemanagement server according to claim 2, wherein the first virtualcreature is implemented as a first robotic device, the second virtualcreature is implemented as a second robotic device, prior to theinformation is received by the processing circuitry, the first virtualcreature is in the activation state, and the second virtual creature isin the sleep state, the first virtual creature is configured to moveinto a first accommodating unit such that the first virtual creature isnot visually recognizable while holding an object provided by a firstuser, and the processing circuitry is further configured to: receive acaptured image obtained by imaging the object held by the first virtualcreature; recognize the object on a basis of the captured image;transmit data for reproducing the object to a second accommodating unitin which the second virtual creature is accommodated; cause areproducing unit installed in the second accommodating unit to reproducea copy of the object according to the data; and transmit the firstcontrol signal and instruct the second virtual creature to come out ofthe second accommodating unit while holding the copy of the object thatis reproduced by the reproducing unit.
 6. The virtual creaturemanagement server according to claim 2, wherein the processing circuitryis further configured to: acquire weather information regarding currentpositions of the first virtual creature and the second virtual creature;and when the information indicates that the first virtual creatureenters the sleep state, transmit the first control signal and transmit,according to the weather information, an image signal to be displayed ona display of a corresponding robotic device or a corresponding terminaldevice by which the second virtual creature is implemented.
 7. Thevirtual creature management server according to claim 2, wherein theprocessing circuitry is further configured to: receive knowledgeinformation about a user learned by the first virtual creature; andgenerate a second control signal for controlling an operation of thesecond virtual creature on a basis of the knowledge information.
 8. Thevirtual creature management server according to claim 7, wherein theprocessing circuitry is further configured to: instruct the firstvirtual creature to take a pose in response to a calling of the user,the pose being randomly selected; receive feedback of the user on thepose as the knowledge information about the user learned by the firstvirtual creature; and store the pose in association with the calling inaccordance with the feedback.
 9. The virtual creature management serveraccording to claim 7, wherein the processing circuitry is furtherconfigured to: receive a face image of the user captured by the firstvirtual creature as the knowledge information about the user learned bythe first virtual creature; and register the user according to arecognition result for the face image.
 10. The virtual creaturemanagement server according to claim 9, wherein the processing circuitryis further configured to: in a case that a person shown together withthe user is recognized from a captured image captured by the firstvirtual creature as a previously registered user, register the user as afamily member of the person.
 11. The virtual creature management serveraccording to claim 2, wherein the processing circuitry is furtherconfigured to: when the first virtual creature positioned at a firstspot is in the activation state, and the second virtual creaturepositioned at a second spot is in the sleep state, and when theinformation indicates that the second virtual creature receives anactivation request from a user at the second spot, and the first virtualcreature is not visually recognizable by the user at the second spot,transmit the first control signal to the second virtual creature forsetting the second virtual creature to the activation state beforetransmitting a second control signal to the first virtual creature forinstructing the first virtual creature to enter the sleep state.
 12. Thevirtual creature management server according to claim 1, wherein theprocessing circuitry is further configured to: receive image informationfrom a camera configured to monitor a particular one of the plurality ofvirtual creatures; and control the plurality of virtual creaturesaccording to the information indicating the current states of theplurality of virtual creatures and according to the image informationfrom the camera configured to monitor the particular one of theplurality of virtual creatures.
 13. The virtual creature managementserver according to claim 2, wherein the processing circuitry is furtherconfigured to: when it is detected that a first user near the firstvirtual creature makes a communication request to a second user near thesecond virtual creature, transmit a second control signal instructingthe first virtual creature to enter the sleep state.
 14. The virtualcreature management server according to claim 13, wherein the processingcircuitry is further configured to: when the information indicates thatthe first virtual creature is in the sleep state, transmit the firstcontrol signal to the second virtual creature for setting the secondvirtual creature to the activation state and transmit a third controlsignal notifying the second virtual creature that there is thecommunication request from the first user to the second user.
 15. Thevirtual creature management server according to claim 2, wherein theprocessing circuitry is further configured to: when the first virtualcreature is in the activation state, and when the information indicatesthat the first virtual creature has no nearby user, transmit a secondcontrol signal to the first virtual creature to stop an operation; andwhen the information indicates that the first virtual creature hasdetected a voice of a predetermined level or higher while the operationis stopped, transmit a third control signal to the first virtualcreature to resume the operation.
 16. The virtual creature managementserver according to claim 2, wherein the processing circuitry is furtherconfigured to: set a moving flag at a predetermined timing; transmit asecond control signal to instruct the first virtual creature that is inthe activation state to enter the sleep state; and when the informationindicating that the first virtual creature enters the sleep state inaccordance with the second control signal is received, transmit thefirst control signal to instruct the second virtual creature that is inthe sleep state to enter the activation state.
 17. A virtual creaturecontrol method, comprising: receiving, by processing circuitry of avirtual creature management server, information indicating currentstates of a plurality of virtual creatures, the plurality of virtualcreatures being visually recognized as a same creature, and each virtualcreature of the plurality of virtual creatures being implemented eitheras a robotic device or as a virtual entity generated by executing asoftware program; generating, by the processing circuitry according tothe current states of the plurality of virtual creatures, at least onesignal for controlling an operation of at least one virtual creatureamong the plurality of virtual creatures, such that at most one of theplurality of virtual creatures is visually recognizable at a time; andtransmitting the at least one signal to the at least one virtualcreature.
 18. The virtual creature control method according to claim 17,further comprising: when the information indicates that a first virtualcreature enters a sleep state corresponding to being not visuallyrecognizable, transmit a first control signal to a second virtualcreature that is in the sleep state, the first control signal settingthe second virtual creature to an activation state corresponding tobeing visually recognizable.
 19. A non-transitory computer-readablemedium storing a program which when executed by a processor of a servercauses the server to perform: receiving information indicating currentstates of a plurality of virtual creatures, the plurality of virtualcreatures being visually recognized as a same creature, and each virtualcreature of the plurality of virtual creatures being implemented eitheras a robotic device or as a virtual entity generated by executing asoftware program; generating, according to the current states of theplurality of virtual creatures, at least one signal for controlling anoperation of at least one virtual creature among the plurality ofvirtual creatures, such that at most one of the plurality of virtualcreatures is visually recognizable at a time; and transmitting the atleast one signal to the at least one virtual creature.
 20. Thenon-transitory computer-readable medium according to claim 19, whereinthe program when executed by the processor of the server further causesthe server to perform: when the information indicates that a firstvirtual creature enters a sleep state corresponding to being notvisually recognizable, transmitting a first control signal to a secondvirtual creature that is in the sleep state, the first control signalsetting the second virtual creature to an activation state correspondingto being visually recognizable.